IAP15 Rec'd PCT/PTO 29 DEC 2005 

WO 2005/041086 PCT/EP2004/052329 

BEST AVAILABLE COPY 10/562456 

METHOD AND SYSTEM FOR INTEGRATION OF INSTANT MESSAGING AND PSTN BASED 
TELECONFERENCING 



Technical Field 

[001] This invention relates to the field of instant messaging and teleconferencing. In 
particular, this invention relates to the integration of instant messaging and telecon- 
ferencing via a telephone network. 

Background Art 

[002] Instant messaging (IM) enables a user to send and receive messages to and from 

other users in real time. A first user has a client IM application or software that runs on 
his computer. When the first user is connected to the Internet, the client IM application 
opens a connection to an IM server. The client IM application sends a user iden- 
tification and password to log onto the IM server. The IM server uses a communication 
protocol that allows for M functionality. 

[003] The client IM application includes a contact list, which is a list of other users that 
the first user wishes to have the ability to send messages to. When the users identified 
in the contact list come online and log on to the IM server, the first user is notified so 
that messages can be sent and received. A message is sent to the IM server, which then 
routes the message to the identified user. IM applications are used primarily for text 
based chats, screen sharing, white-boarding and so on. 

Disclosure of Invention 

[004] This invention relates to the integration of telephony features and conferencing into 
IM applications. Traditional telephone networks convert sound to electric signals or 
use wireless communication via radio waves. The widespread telephone network is 
called the Public Switched Telephone Network (PSTN). Audio telephone conferencing 
using the PSTN is a long established means of group communication. . 

[005] In audio teleconferencing, n participants are connected via the PSTN at the same 
time. Teleconferencing usually requires an audio bridge. An audio bridge has the 
function of interconnecting multiple telephone channels. A bridge provides smooth 
voice switching and even distribution of audio signals to all locations and controls 
transmission quality. Some bridges use a switch that opens a transmission in response 
to a voice message and other talkers are blocked until the voice message has finished. 
Other forms of bridge allow more than one talker to be transmitted at the same time. 
Bridges may have dial-in or dial-out capabilities, which may be handled by an operator 
or bridging service. 
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[006] The advantages of this form of group communication are that there is good quality 
of sound in which the tone of participants' voices can be distinguished and participants 
can speak spontaneously. Also, use of telephone apparatus is extremely widespread 
with people having telephones at their places of work, homes as well as mobile 
telephones. 

[007] The disadvantages of telephone conferencing are that a speaker may need to 

identify himself before speaking and confusion can arise if more than one person talks 
at the same time. It can also be difficult to notify all the participants of an intended 
conference and it is time consuming for an organiser of the conference to dial all the 
appropriate telephone numbers to connect all the participants. This final point is par- 
ticularly true as people have more than one telephone apparatus usually including a 
mobile telephone. 

[008] Voice over IP (VOIP) or Internet telephony are ways of making a telephone call 
over the Internet instead of the PSTN. The disadvantage with this form of com- 
munication is that the audio is digitised and converted into IP packets. VOIP is 
typically delivered using RTP (Real time protocol) over UPD (User datagram 
protocol). At the other end of the call, the digitised voice data is converted back to an 
audio signal. This conversion can result in unclear and disjointed voice reproduction. 

[009] There are three main downfalls of VIOP, namely packet delay, packet loss and 
jitter. Jitter arises due to variable packet inter-arrival time; some packets take longer 
than others causing jitter at the receiver. These are caused by the best effort service 
provided by the Internet protocol (IP). 

[010] Some IM applications enable VOIP calls to be set up and integrated with the IM ap- 
plication. This suffers from the limitations of computer to computer VOIP such as 
quality of sound issues and scalability issues as the conference grows in size. VOIP, 
especially over the public Internet is still not reliable enough for high quality audio 
conferences. Another downfall of VOIP computer to computer conferences is that 
microphone equipment is not as widespread and immediately available to all par- 
ticipants as telephone apparatus. 

[01 1] Some existing IM applications also allow a user who has signed up to a telephone 
service provider to call another user, setting up a single one to one phone call. This is 
basic telephone integration but does not provide N way teleconference facilities. Some 
forms of IM applications can also send SMS (Short Message Service) texts to mobile 
users. 

[012] The invention described here utilizes the high quality and availability of the con- 
ventional telephone network and integrates audio teleconferencing into IM ap- 
plications. The integration of teleconferencing into an JM application involves the 
merging of teleconferencing on the telephone network with the simplicity and real- 
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time awareness features of IM applications. 

[013] According to a first aspect of the present invention there is provided a system 

comprising a plurality of instant messaging client applications communicating via a 
computer network to send and receive messages in real time integrated with n-way 
teleconferencing capability via a telephone network. 

[014] In a preferred embodiment, the system comprises: a plurality of instant messaging 
client applications; an instant messaging server; and a teleconferencing server, all 
connected via a computer network; wherein the teleconferencing server enables n-way 
telephone connections via the telephone network. 

[015] The teleconference server preferably includes communication means to send noti- 
fications to the instant messaging server of the status of telephone connections during a 
teleconference. 

[016] The instant messaging client applications may have graphical user interfaces 

including means for displaying in real time details of participants of an n-way tele- 
conference and the status of the telephone connections of the participants. 

[017] The n-way telephone connections may be to telephone apparatus of users of the 

instant messaging client applications. An additional telephone connection may also be 
to a telephone apparatus of a user who is not a user of an instant messaging client ap- 
plication. 

[018] The graphical user interface may include means for indicating a participant who is 
talking at a given time in the teleconference, the means for indicating being activated 
in response to notification from the teleconference server. The graphical user interface 
may also include means for a user to input an indication that the user wishes to speak. 

[019] The teleconferencing server may use a bridge which interfaces with the telephone 
network that interprets set up and control commands relating to a teleconference. The 
teleconference server may allow the system to utilise different network interfaces. 

[020] The teleconference server may include an interface allowing an instant messaging 
client application to set up and control a teleconference. The teleconference server may 
also include a telephone profile service for retrieving and storing telephone profiles, 
and a teleconference profile service for managing teleconference profiles including 
policy information, pin numbers and port allowances. 

[021] One of the instant messaging client applications may be a moderator of the tele- 
conference and may have a graphical user interface including control input means for 
controlling the teleconference. 

[022] The graphical user interface may include means for providing a telephone number 
at which a participant can be connected for the teleconference. 

[023] According to a second aspect of the present invention there is provided a method in 
which a plurality of users each with an instant messaging client application 
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communicate in real time by instant messages via a computer network and can be si- 
multaneously connected by an n-way teleconference via a telephone network. 

[024] In a preferred embodiment, the method includes: a plurality of instant messaging 
applications communicating by instant messages via an instant messaging server on a 
computer network; and establishing n-way telephone connections via a telephone 
network using a teleconferencing server on the computer network. 

[025] A user of an instant messaging client application may set up and control a tele- 
conference by instant messaging communication with a teleconference server. The user 
initiating the teleconference may send an instant message in the form of an invitation 
to proposed participants of the teleconference. Non-users of instant messaging ap- 
plications may also participate in the n-way teleconference by dialling in themselves or 
being dialled in by another participant. 

[026] The teleconference server may notify the instant messaging server of the status of 
telephone connections. 

[027] The method may include providing graphical user interfaces for the instant 

messaging client applications including displaying in real time details of participants of 
an n-way teleconference and the status of telephone connections of the participants. 
The method may also include activating an indication in the graphical user interface of 
a participant who is talking at a given time in the teleconference, in response to a no- 
tification sent from the teleconference server. 

[028] The method may include a user inputting a telephone number in the graphical user 
interface at which they can be contacted for a proposed teleconference. 

[029] According to a third aspect of the present invention there is provided a computer 
program stored on a computer readable storage medium, comprising computer 
readable program code means for performing the steps of: providing an instant 
messaging client application for communicating with other instant messaging client ap- 
plications by instant messages delivered via an instant messaging server on a computer 
network; the instant messaging client application having an extension for enabling tele- 
conferencing using a teleconferencing server on the computer network enabling n-way 
telephone connections via the telephone network. 

[030] According to a fourth aspect of the present invention there is provided a computer 
program stored on a computer readable storage medium, comprising computer 
readable program code means for performing the steps of: providing a plurality of 
instant messaging applications (202, 207, 208, 209) communicating by instant 
messages via an instant messaging server (204) on a computer network (206); and es- 
tablishing n-way telephone connections via a telephone network (216) using a telecon- 
ferencing server (210) on the computer network (206). 

[031] Using the integration of teleconferencing with instant messaging, users are capable 
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of initiating audio teleconferences using their IM application with the same semantics 

as those in n-way text chats. 

[032] This invention expands the scope of the IM applications into the domain of telecon- 
ferencing on the telephone network and introduces a host of new possibilities. Tele- 
conferences can be set up and destroyed in an adhoc manner in real time as easily as 
text chats. The telephony status within an IM community can be communicated and 
shown in real time improving telephony awareness. 

[033] Another advantage of integration of IM and teleconferencing is concerned with 

participant experience. The teleconference can be visualized from the IM applications. 
As contacts are being dialled, pick up, hang up, are dropped, are muted, are speaking 
this can be graphically displayed to all other participants in the teleconference. 

[034] In a regular teleconference, as there is no user interface, only the telephone handset, 
participant status is not available. With IM integration all participants are capable of 
viewing the state of all other participants such as who is talking, what their name is and 
where they are currently located. It is also possible to see external participants and see 
when participants have picked up their telephone and when they have decided to hang 
up and leave. 

[035] Other very attractive features are awareness of teleconference involvement to other 
users as well as automatically generated teleconference summaries in terms of contact 
involvement, time, date and duration. 

[036] Another feature is intelligent use of resources, if a moderator invites a number of 
people to a teleconference and finds that only one has accepted the invitation then fhe 
system can downgrade the teleconference to a simple telephone call and thus save on 
expense. 

Brief Description of the Drawings 

[037] Embodiments of the present invention will now be described, by way of examples 

only, with reference to the accompanying drawings in which: 
[038] Figure 1 is a block diagram of an instant messaging system as known in the prior 

art; 

[039] Figure 2 is a block diagram of a system in accordance with the present invention; 
[040] Figure 3 is a block diagram of the teleconference server of the system of Figure 2; 
[041] Figure 4 is a screen shot of an instant messaging graphical user interface in 

accordance with the present invention; 
[042] Figures 5 A and 5B are screen shots of a teleconference set up dialog box and 

invitation as extensions to the instant messaging graphical user interface of Figure 4; 

and 

[043] Figures 6A to 6D are screen shots of a teleconference graphical user interface in 
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accordance with the present invention. 

Mode for the Invention 

[044] There is described a system in which instant messaging is integrated with telecon- 
ferencing via a telephone network. 

[045] Figure 1 shows an instant messaging system as known in the prior art. An instant 
messaging (EM) client application 102 runs on a computer of a first user. An IM 
service application, also referred to as an IM server 104, provides the IM functionality 
via a network such as the Internet 106. 

[046] When the IM client application 102 logs on to the IM server 104, the server checks 
a screen name and password. This may be done by a separate login server. The IM 
server 104 uses a communications protocol that allows for IM functionality. The IM 
client application 102 has a graphical user interface, which displays the instant 
messaging functionality. 

[047] The IM client application 102 includes contact list capabilities. A list of people the 
first user would like to send and receive messages to and from is stored in the IM client 
application 102. This list of the screen names of the contacts is communicated to the 
IM server 104 so that when the listed people come online, the first user is notified by 
the IM server 104. 

[048] Each contact has its own IM client application 107, 108, 109 which runs on each of 
their computers. When any of the contacts logs on, the first user's IM client application 
102 is notified that they are online. Instant Messages can then be sent and received in 
real time. Each message goes to the IM server 104, which routes the message to the 
intended recipient. 

[049] Referring to Figure 2, a system 200 in accordance with the present invention is 
shown. A user has an IM client application 202 with an extension 203 that provides 
teleconferencing functionality. An IM server 204 also has an extension 205 that 
provides the teleconferencing integration features. Other users each have IM client ap- 
plications 207, 208, 209 with teleconference extensions (not shown). 

[050] Users log on to the IM server 204 as described above in relation to Figure 1 in order 
to send and receive instant messages between contacts in real time. 

[051] One or more teleconference service application, also referred to as a teleconference 
server 210, is provided which is the gateway between the IM server 204 and a network 
interface or an audio bridge 212 connected to a telephone network 216. The tele- 
conference server 210 connects to the IM server 204 and also connects to the network/ 
bridge 212. A teleconference server 210 acts as an interface module for the IM server 
204 and the network/bridge 212. 

[052] The IM server 204 is first configured to recognise one or more teleconference 
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servers 210, it is irrelevant how this takes place only that the 1M server 204 knows that 
any client requests to setup and control teleconferences go to the teleconference 
server(s) 210. 

[053] The teleconference server 210, on client requests, uses a local conference setup/ 
control interface module to set up and control teleconferences on the PSTN (public 
switched telephone network) 216. The interface module is a software element with an 
interface that implements the set up, management, control and destruction of 
conferences on the telephone network. The conference set up/control interface module 
provides to the teleconference server 210 a generic interface allowing the set up and 
control of a teleconference. The importance of this interface module is that the tele- 
conference server 210 can interoperate with different implementations of the 
conference set up/control interface. 

[054] The actual implementation of the conference set up/control interface module can be 
provided by an audio conferencing bridge 212. The audio conferencing bridge 212 is a 
device that interfaces with the PSTN 216 possibly using one or more high capacity 
ISDN connections (e.g. ISDN PRI (Primary rate)). The audio conferencing bridge 212, 
at a basic functional level, is capable of setting up connections on the PSTN 216 and 
mixing the sound incoming on a number or connections and transmitting the mixed 
sound back out on the same connections (i.e. conferencing). 

[055] The bridge 212 can also be dialled using a telephone handset and a user can create 
or join a conference by inputting a valid pin number. The audio conferencing bridge 
212 interprets messages from the teleconference server 210 relating to conference set 
up and control and provides feedback on conference state to the teleconference server 
210. This messaging and feedback takes place via the conference set up/control 
interface module running on the teleconference server 210. hi this scenario, the bridge 
212 can be considered as implementing the network interface. 

[056] Another possible implementation of the conference set up/control interface which 
allows the teleconference server 210 to set up conferences could use one of die 
emerging network APFs such as Parlay (trade mark of The Parlay Group). Parlay is an 
interface that is designed for use by applications which rely the on the telecoms 
network. Parlay has provisions for conferencing where implemented in the network. 
The teleconference server 210 could communicate with a Parlay gateway via the 
conference set up/control interface for access to the network. The scenario above 
requires a network that implements the Parlay interface. 

[057] Along with allowing the set up and control of conferences the teleconference server 
210 also uses the services of the IM server 204 to communicate the real time state of 
the conference to the participating clients 202, 207, 208, 209. This is accomplished by 
interpreting and processing feedback from the conference set up/control module. 
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[058] The teleconference server 210 is used to set up telephone connections via a 

telephone network 216 such as the PSTN with each participant of a teleconference. A 
teleconference can then be carried out between participants simultaneously with the 
running of IM client applications by the participants. 

[059] Each of the IM client applications 202, 207, 208, 209 with teleconferencing 

extensions can also communicate directly with the teleconference server 210. The tele- 
conferencing server 210 allows IM users to set up and control a teleconference as a 
moderator and also allows IM users who have been invited to a teleconference to take 
part as a participant. 

[060] Notifications regarding the setting up and status of telephone connections with each 
of the participants of a teleconference are sent by the teleconference server 210 to the 
IM server 204. The IM server 204 notifies the IM client applications 202, 207, 208, 
- 209 of the teleconference participants of the status of the telephone connections. 

[061] Each of the IM client applications 202, 207, 208, 209 has a graphical user interface 
with added functionality for teleconferencing. The graphical user interface displays in- 
formation relating to the teleconference and the status of each participant's telephone 
connection as shown further below. The extension 205 of the IM server 204 which 
provides the teleconference integration features updates the information displayed by 
the graphical user interfaces of the IM client applications. 

[062] Figure 3 shows the functionality of the teleconference server 210 in more detail. 

The teleconference server 210 provides a telephone profile service 230 which retrieves 
and stores the IM users' telephone profiles from a directory 231. The teleconference 
server 210 also provides an interface 232 allowing IM users to set up and control tele- 
conferences as moderators and also allows IM users who have been invited to a tele- 
conference to take part as a participant. The teleconference server 210 also manages 
teleconference profiles 234 such as policy information, pin number, port allowance and 
so on. 

[063] To interface with the telephone network 216, in order to setup and manage 

telephone connections, the teleconference server 210 uses a network interface plug-in 
236 that interprets standard setup and control commands relating to audio tele- 
conferences. The plug-in architecture 236 allows the system to utilize a number of 
different network interfaces such as an audio conferencing bridge 238, a Java (trade 
mark of Sun Microsystems, Inc.) based network API 240 (JAIN (Java APIs for In- 
telligent Networks) and JTAPI (Java Telephony API)), or other network interfaces 242 
such as the Parlay interface. The teleconference server 210 sets up a telephone 
connection 244 to each participant via the audio bridge or the network API imple- 
mentation. 

[064] The following is a description of the user experience of the described system 
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including screen shots of examples of graphical user interfaces which could be used. 
An initiator of a teleconference sets up a teleconference and invites other participants 
to the teleconference. A moderator controls the teleconference. The initiator and the 
moderator may often be the same user. However, the moderator can change during the 
course of a teleconference, if required. 
[065] The user of the IM client application 202 is presented with the usual IM graphical 
user interface (GUI) 400 as shown in Figure 4. In a teleconference integrated IM client 
application 202, there is an extension allowing the user access to teleconference func- 
tionality. For example, this is illustrated by the telephone icon 402 circled in the 
toolbar 404. 

[066] The user can click on a number of IM contacts 406 in their contact list 408 and click 
on the telephone icon 402 to begin an audio teleconference between the selected 
contacts. When the user does this, he is presented with a teleconference setup dialog - 
box 500 as shown in Figure 5A. 

[067] In the teleconference setup dialog box 500, the user who is initiating the tele- 
conference can select the location 501 at which he would like to be dialled when the 
teleconference begins. The initiating user can also enter the description of the tele- 
conference 502 and a message 503 to be sent to the intended participants. The user has 
a password or personal identification number (PIN) as a user 504 and as the moderator 
505 of the teleconference. 

[068] The user can add invitees by clicking on the "Add Invitees" button 507. A list 506 
shows the invitees currently selected. When the user is satisfied with the list of 
invitees, he can send the invitations by clicking on the "Send" button 508. A "Cancel" 
button 509 is also provided. 

[069] When the "Send" button 508 is clicked, invitations 510 to the teleconference are 
sent to the intended participants. An invitation 510 in the form of a dialog box is 
shown in Figure 5B. The invitation 510 includes details of the moderator 511 and the 
description 502 and the message 503 as provided by the moderator. 

[070] The intended participant has the option to either accept or reject the invitation to the 
teleconference. If the participant accepts the invitation, he must choose one of his pre- 
configured telephone locations 512 at which he wishes to be dialled. Alternatively, he 
may enter a new telephone number in the dial location 512. 

[071] The invitation 510 also shows the other invitees 513 and their status as they respond 
to the invitation. The status of the invitees is sent and received via the IM client ap- 
plications and IM server in real time as the invitees respond. A button 514 is provided 
on the invitation 5 10 to join the teleconference. A button 516 is also provided to 
respond to the invitation. 

[072] Once a participant has accepted the invitation and joined the teleconference, he is 
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presented with a view of the teleconference in the form of a teleconference GUI 600 
shown in Figures 6A to 6D. 
[073] The moderator who initiated the teleconference is presented with a more featured 

view of the teleconference GUI 600. Both views show as participants 601 join the tele- 
conference and their status 602. The moderator of the teleconference is shown by a key 
609 next to his name. 

[074] In the moderator' s view of the teleconference GUI 600, there are various call 

control options such as mute 603, drop 604, invite 605 and invite external users 606. 
The whistle icon 607 entitled "moderator" is provided to allow the moderator to pass 
moderator rights to others. The participants' view is identical to the moderator's view 
except that they do not have the conference control toolbar. The teleconference GUI 
600 includes input buttons for indicating a gesture 610 such as raising a hand. 

[075] When the teleconference starts, the moderator is dialled at their chosen number and 
all those who accepted the invitation are also dialled at their chosen numbers by the 
teleconference server. Once the participants are connected by telephone, the user 
currently speaking is depicted by an icon with the talking animation 608. Notifications 
of who is speaking and call status is sent from the teleconference server to the IM 
server which sends the instant messages to the IM client applications which show the 
status graphically in the teleconference GUI 600. 

[076] Figure 6B depicts the entrance of a dial in participant to the teleconference depicted 
by the globe icon 61 1. The dial in contact does not have an IM profile and this is a 
guest. 

[077] As well as dial in, the moderator can dial out external users, who are not IM users, 
into the teleconference. This is shown in Figure 6C. By selecting the "invite ext" 
option 606, the moderator can select someone to dial out into the teleconference. A 
dialog box 612 is displayed to the moderator in which the moderator can input the 
details of the invitee. 

[078] Figure 6D shows that the external user has been dialled out and is now in the tele- 
conference 615. This figure also shows that one of the participants is signalling to 
speak as he has raised his flag 613. 

[079] Along with the features described above, the system notifies users when a 

participant picks up and hangs up from the teleconference. When a participant hangs 
up, his name is ghosted out and his icons disappear. The moderator can stop the tele- 
conference at any time by selecting stop 614. 

[080] A general description of the use of the system integrating instant messaging and 
teleconferencing is now provided. An IM client application user is able to set up an 
audio teleconference with a number of his contacts from his IM client application 
interface. A teleconference is started when the IM user selects a number of IM contacts 
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and indicates via his interface that he wishes to start a teleconference. The contacts 
receive invitations to the teleconference and can choose to accept at any of a number of 
preconfigured telephone "locations" such a home, office, mobile or define new 
locations as required. A location is made up of a telephone number and a descriptor 
such as ( 087 - xxxxxxx Mobile ). Using this feature a user need not constantly be 
dialling telephone numbers. 

[081] Once participants accept the invitation to the teleconference at their selected 
location they receive a graphical description of the teleconference. The user who 
initiated the teleconference is designated the moderator of the conference unless the 
user indicates otherwise. The moderator can view the status of the teleconference from 
his IM client application and, once satisfied that enough members are present, he can 
start the teleconference by selecting start from the graphical user interface. 

[082] Starting the teleconference involves the teleconference server dialling all users in 

* 

the teleconference using their selected telephone locations. Once the IM users par- 
ticipating in a teleconference are physically dialled into the teleconference the instant 
messaging application visualizes their real time state changes on the telephone 
network. Notification of any status change on the telephone network is sent by the tele- 
conference server to the IM server and this is graphically illustrated in the user 
interfaces of the IM client applications in real time. As participants pick up their 
telephone their virtual state is graphically changed, if they speak this is also signalled 
by state change which is visible to all participants involved in the call. 

[083] For participants wishing to dial into a teleconference who are not instant messaging 
users there are two scenarios. The moderator can dial out a user using the tele- 
conference control graphical user interface. Alternatively, the participant can dial into 
an ongoing teleconference. Either way the user is represented as a guest in the tele- 
conference visual dialog and inherits the same state as other participants which can be 
visualized by all other participants. 

[084] During an ongoing teleconference, IM users can be invited and can join into the 
ongoing teleconference. Once they accept the invitation, they receive the tele- 
conference graphical user interface component and are dialled into teleconference. 

[085] Visual teleconference state is augmented by participant to participant signalling. 

Participants can signal one another using simple 2 or even n-way text chats using the 
IM applications. Along with text chats, users can also graphically signal to one another 
in the teleconference. Participants can raise their virtual hand to signal to the moderator 
that they wish to speak; they can also get in line to speak; and also signal that they are 
away for a moment. This is all done using the IM application extension that provides 
such real time awareness. 

[086] Throughout the teleconference, there is a moderator who has, in addition to the 
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graphical display of the teleconference, a teleconference control graphical user 
interface component implementing call control. The moderator using his IM client ap- 
plication is capable of muting, un-muting, dropping, dialling and implementing other 

* 

call control features on participants. The moderator can also control the conference 
itself from the GUI such as sidelining participants into sub-conferences, locking the 
conference, dialling out external users, recording the conference and so on. 

[087] A related point on moderator rights is transferral. With integration of instant 

messaging into teleconferencing users are capable of transferring moderator rights to 
other participants. If the moderator must leave the teleconference, instead of leaving an 
idle telephone picked up or off hook, so as to not destroy the teleconference, the 
moderator can pass moderator rights to a trusted contact and leave the teleconference. 

[088] To end an IM integrated teleconference the moderator can choose to stop the 

conferencein which all participants are hung up. The moderator can also choose to 
drop a number of participants or single participants from their teleconference contact 
list. If all participants hang up the teleconference will also be terminated. 

[089] Commonly in teleconferences a number of participants dial in from a single 
location, perhaps a conference room with a speaker phone. To accommodate this 
feature the system represents users with the same dial location (physical telephone) as 
a group in the teleconference. The group has attributes such as muted and when a 
single person in the group speaks the teleconference GUI signals that speech is taking 
place within the group. 

[090] Integration allows teleconference metrics to be collated by the IM application such 
as who is or was talking the most, number of participants, length of the conference, 
talk time as opposed to silence, and so on. These metrics can be visualized in real time 
graphs or bar charts during and after the teleconference. 

[091] Finally, during an ongoing teleconference other users in the IM community can be 
made aware of the fact that a user is in teleconference by showing "in teleconference" 
status as well as the phone location being used. This means that they may be available 
for chat but may not want to be invited to another teleconference until they are finished 
their current .teleconference. This allows other users to make informed decisions about 
contacting an engaged user. 

[092] Parts of the present invention are typically implemented as computer program 
products, comprising a set of program instructions for controlling a computer of 
similar device. These instructions can be supplied preloaded into a system or recorded 
on a storage medium such as a CD-ROM, or made available for downloading over a 
network such as the Internet or a mobile telephone network. 

[093] Improvements and modifications can be made to the foregoing without departing 
from the scope of the present invention. 
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Claims 

[001] A system comprising a plurality of instant messaging client applications (202, 

207, 208, 209) communicating via a computer network (206) to send and receive 
messages in real time integrated with n-way teleconferencing capability via a 
telephone network (216). 

[002] A system as claimed in claim 1, wherein the system comprises: a plurality of 

instant messaging client applications (202, 207, 208, 209); an instant messaging 
server (204); and a teleconferencing server (210); all connected via a computer 
network (206); wherein the teleconferencing server (210) enables n-way 
telephone connections via the telephone network (216). 

[003] A system as claimed in claim 2, wherein the teleconference server (210) includes 

communication means to send notifications to the instant messaging server (204) 
of the status of telephone connections during a teleconference. 

[004] A system as claimed any one of claims 1 to 3, wherein the instant messaging 

client applications (202, 207, 208, 209) have graphical user interfaces (400, 600) 
including means for displaying in real time details of participants of an n-way 
teleconference and the status of the telephone connections of the participants. 

[005] A system as claimed in any one of the preceding claims, wherein the n-way 

telephone connections are to telephone apparatus of users of the instant 

* 

messaging client applications (202, 207, 208, 209). 
[006] A system as claimed in claim 5, wherein an additional telephone connection is to 

a telephone apparatus of a user (611, 615) who is not a user of an instant 

messaging client application. 
[007] A system as claimed in any one of claims 4 to 6, wherein the graphical user 

interface (600) includes means for indicating a participant who is talking (608) at 

a given time in the teleconference, the means for indicating being activated in 

response to notification from the teleconference server (210). 
[008] A system as claimed in any one of claims 4 to 7, wherein the graphical user 

interface (600) includes means for a user to input an indication (610) that the 

user wishes to speak. 

[009] A system as claimed in any one of claims 2 to 8, wherein the teleconferencing 

server (210) uses a bridge (212) which interfaces with the telephone network 

■ 

(216) that interprets set up and control commands relating to a teleconference. 
[010] A system as claimed in claim 9, wherein the teleconference server allows the 

system to utilise different network interfaces (238, 240, 242). 
[011] A system as claimed in any one of claims 2 to 10, wherein the teleconference 

server (210) includes an interface (232) allowing an instant messaging client ap- 
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plication (202) to set up and control a teleconference. 
[012] A system as claimed in any one of claims 2 to 1 1, wherein the teleconference 

server (210) includes a telephone profile service (230) for retrieving and storing 
telephone profiles, and a teleconference profile service (234) for managing tele- 
conference profiles including policy information, pin numbers and port 
allowances. 

[013] A system as claimed in any one of the preceding claims, wherein one of the 

instant messaging client applications (202, 207, 208, 209) is a moderator of the 
teleconference and has a graphical user interface (400, 600) including control 
input means (605, 606, 607, 603, 604) for controlling the teleconference. 

[014] A system as claimed in any one of claims 4 to 13, wherein the graphical user 

interface (400) includes means for providing a telephone number at (501, 512) 
which a participant can be connected for the teleconference. 

[015] A method in which a plurality of users each with an instant messaging client ap- 

plication (202, 207, 208, 209) communicate in real time by instant messages via 
a computer network (206) and can be simultaneously connected by an n-way 
teleconference via a telephone network (216). 

[016] A method as claimed in claim 15, wherein the method includes: a plurality of 

instant messaging applications (202, 207, 208, 209) communicating by instant 

messages via an instant messaging server (204) on a computer network (206); 

■ 

and establishing n-way telephone connections via a telephone network (216) 
using a teleconferencing server (210) on the computer network (206). 

[017] A method as claimed in claim 15 or claim 16, wherein a user of an instant 

messaging client application (202) sets up and controls a teleconference by 
instant messaging communication with a teleconference server (210). 

[018] A method as claimed in claim 17, wherein the user initiating the teleconference 

sends an instant message in the form of an invitation (510) to proposed par- 

» 

ticipants of the teleconference. 
[019] A method as claimed in any one of claims 15 to 18, wherein non-users of instant 

messaging applications can also participate in the n-way teleconference by 

dialling in themselves or being dialled in (612) by another participant. 
[020] A method as claimed in any one of claims 16 to 19, wherein the teleconference 

server (210) notifies the instant messaging server (204) of the status of telephone 

connections. 

[021] A method as claimed in any one of claims 15 to 20, wherein the method includes 

providing graphical user interfaces (400, 600) for the instant messaging client ap- 
plications (202, 207, 208, 209) including displaying in real time details of par- 
ticipants of an n-way teleconference and the status of telephone connections of 
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the participants. 

[022] A method as claimed in claim 21, wherein the method includes activating an 

indication (608) in the graphical user interface (600) of a participant who is 
talking at a given time in the teleconference, in response to a notification sent 
from the teleconference server (210). 

[023] A method as claimed in claim 21 or claim 22, wherein the method includes a 

user inputting a telephone number (501, 512) in the graphical user interface at 
which they can be contacted for a proposed teleconference. 

[024] A computer program stored on a computer readable storage medium, comprising 

computer readable program code means for performing the steps of: providing an 
instant messaging client application (202) for communicating with other instant 
messaging client applications (207, 208, 209) by instant messages delivered via 
* an instant messaging server (204) on a computer network (206); providing an 
extension to the instant messaging client application (202) for enabling telecon- 
ferencing using a teleconferencing server (210) on the computer network (206) 
enabling n-way telephone connections via the telephone network (216). 

* 

[025] A computer program stored on a computer readable storage medium, comprising 

* 

computer readable program code means for performing the steps of: providing a 
plurality of instant messaging applications (202, 207, 208, 209) communicating 
by instant messages via an instant messaging server (204) on a computer network 

♦ 

(206); and establishing n-way telephone connections via a telephone network 
(216) using a teleconferencing server (210) on the computer network (206). 
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